# Domain-Adaptive Pretraining

RigoBERTa Clinical Edition is the state-of-the-art encoder language model for the Spanish clinical domain, developed through domain-adaptive pretraining on the largest publicly available Spanish clinical corpus, ClinText-SP.

A domain-adaptive language model optimized for German job advertisements, continuously pre-trained based on bert-base-german-cased

ConfliBERT is a pre-trained language model specifically designed for political conflicts and violent events, offering four different versions to suit various needs.

A BERT model initialized with BioBERT and further pretrained on health-related Reddit posts, specializing in processing medical texts from social media

Based on the mengzi-bert-base model, further trained with 20G of financial news and research report data, focusing on natural language processing tasks in the Chinese financial domain.